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ABSTRACT 

Evaluating  complex  propositions  that  are  composed  of  sev¬ 
eral  lotteries  is  a  difficult  task  for  humans.  Presentation 
styles  can  affect  the  acceptance  rate  of  such  proposals.  We 
introduce  an  agent  that  chooses  between  two  presentation 
methods,  while  aspiring  to  maximize  proposal  acceptance. 
Our  agent  uses  decision  theory  in  order  to  model  human  be¬ 
havior  and  uses  the  model  to  select  the  presentation  which 
maximizes  its  expected  outcome.  We  examine  several  deci¬ 
sion  theories,  and  use  machine  learning  to  adapt  them  to  our 
domain.  We  perform  an  extensive  evaluation  of  our  agent  in 
comparison  to  other  baseline  agents  and  show  that  presen¬ 
tation  can  indeed  affect  the  acceptance  rate  of  propositions 
and  that  the  agent  we  propose  succeeds  in  selecting  beneh- 
cial  presentations. 
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1.  INTRODUCTION 

Many  systems  are  designed  to  encourage  users  to  accept 
beneficial  proposals.  Complex  propositions  often  confuse  the 
user  and  make  the  decision  non-trivial.  It  is  well  known  that 
problem  presentation  [23,  11,  14]  may  have  an  impact  on  the 
human  decision-making  process.  In  our  work  we  consider 
beneficial  proposals  which  are  composed  of  several  gains  or 
losses,  that  are  associated  with  varying  probabilities  and 
must  be  accepted  or  rejected  together.  We  will  compare  two 
possible  presentation  methods  (for  the  possible  outcomes 
and  their  associated  probabilities)  for  each  proposal:  a  sep¬ 
arate  presentation  and  a  combined  presentation.  Many  real 
life  situations  resemble  our  problem. 

Our  first  example  is  a  medical  system  which  assists  a  doc¬ 
tor  or  patient  in  deciding  whether  to  use  a  certain  medica¬ 
tion.  The  medication  is  associated  with  one  or  more  benehts, 
such  as  curing  the  infection  or  reducing  pain,  and  also  with 
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several  side  effects,  such  as  headache,  nausea,  rash  or  an  al¬ 
lergic  reaction.  These  outcomes  have  varied  significance;  for 
instance,  a  headache  might  be  slightly  unpleasant  whereas 
an  allergic  reaction  could  be  life  threatening.  Each  of  these 
outcomes  is  also  associated  with  a  certain  probability;  for  ex¬ 
ample,  the  probability  of  overcoming  the  infection  may  be 
90%  while  the  side  effect  of  a  headache  might  occur  in  20%  of 
the  patients,  whereas  an  allergic  reaction  might  only  become 
evident  in  0.5%  of  the  patients.  The  expected  overall  reac¬ 
tion  to  the  medication  must  be  positive  (otherwise  it  is  more 
harmful  than  helpful).  In  order  to  decide  whether  to  use  a 
medication,  all  of  the  potential  benefits  and  the  risk  of  side 
effects  must  be  evaluated  together.  Combining  the  various 
components  is  associated  with  a  cost,  since  it  is  unclear  how 
to  quantify  a  headache  compared  to  a  rash.  Different  peo¬ 
ple  may  associate  different  values  with  each  beneht  or  side 
effect.  Therefore  assigning  values  to  the  components  using  a 
joined  metric  would  require  some  effort,  such  as  questioning 
many  people  on  their  preferences,  and  therefore  impose  a 
cost. 

Another  example  is  an  investment  adviser  who  is  trying 
to  build  an  investment  portfolio  for  one  of  his  customers. 
Some  stocks  have  a  higher  risk  but  also  offer  an  opportunity 
to  receive  greater  interest,  while  on  the  other  hand  one  can 
invest  in  a  bond  with  a  lower  risk  and  a  lower  interest  level. 
Most  people  combine  different  stocks  and  bonds,  combining 
different  levels  of  risk.  The  investment  adviser’s  primary 
goal  is  to  get  the  customer  to  invest  her  money,  therefore  he 
would  like  to  show  the  portfolio  to  the  customer  using  the 
most  appealing  presentation.  Should  the  investment  adviser 
show  the  expected  probability  and  value  of  revenue  (or  loss) 
for  each  stock,  or  should  he  try  to  combine  all  stocks  in  a 
single  chart  which  presents  the  total  investment? 

Our  last  example  is  a  travel  agent  who  would  like  to  pro¬ 
mote  the  sales  for  a  specific  vacation  package.  Every  day  of 
a  multiple-day  vacation  has  some  probability  of  rain  or  heat 
load  (the  strength  of  the  rain  or  heat  load  may  also  vary). 
The  travel  agent  wants  to  show  the  customer  the  probabil¬ 
ities  for  rain  on  each  of  the  planned  days.  How  should  the 
travel  agent  present  these  probabilities  (while  his  goal  is  to 
sell  the  package)?  Should  he  present  them  for  every  day 
separately,  or  should  he  combine  them  all  in  one  chart? 

In  order  to  determine  how  to  present  complex  propos¬ 
als,  we  propose  an  automated  agent  that  utilizes  behavioral 
economic  theory.  A  prospect  is  a  lottery  (possibly  with  sev¬ 
eral  outcomes,  where  each  outcome  has  its  own  probability) 
[19],  and  a  simple  prospect  is  a  prospect  with  some  prob¬ 
ability  p  to  gain  or  lose  some  amount  x  and  gain  or  lose 
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nothing  otherwise.  The  problems  we  study  in  this  paper 
are  composed  of  several  simple  prospects.  These  prospects 
must  either  all  be  accepted  or  all  be  rejected  (there  is  no 
option  to  accept  a  partial  set  of  prospects)  and  the  system 
gains  from  accepted  proposals.  In  the  medical  system  we 
described  earlier,  the  benefit  of  cure  infection  with  a  prob¬ 
ability  of  90%  (and  10%  of  not  curing  the  infection)  is  an 
example  of  a  prospect,  and  similarly  so  is  the  side  effect  of 
acquiring  a  headache  with  a  probability  of  20%  (and  80% 
of  not  resulting  in  a  headache).  All  of  the  prospects  must 
be  selected  or  rejected  together  since  a  patient  either  takes 
the  medication  or  does  not.  The  agent  we  propose  must  de¬ 
cide  whether  to  present  the  proposal  in  a  separate  method, 
as  is,  or  in  a  combined  method,  combining  all  of  the  sim¬ 
ple  prospects  into  a  single  (more  complex)  prospect.  For 
example,  in  the  medical  system  the  separate  method  would 
list  all  of  the  separate  prospects.  In  combined  presentation 
combining  the  curing  prospect  with  the  headache  prospect 
results  with  a  72%  chance  that  infection  will  be  cured  with¬ 
out  the  headache  side  effect  appearing,  an  18%  chance  that 
the  infections  will  be  cured  and  a  headache  will  appear,  an 
8%  that  the  infection  will  not  be  cured  and  no  headache 
will  appear  and  finally  a  2%  chance  that  the  infection  will 
not  be  cured  and  that  a  headache  will  appear.  Note  that 
in  the  combined  method  all  of  the  probabilities  add  up  to 
100%.  We  assumed,  and  show  experimentally,  that  present¬ 
ing  the  problem  as  a  set  of  simple  prospects  or  as  a  combined 
prospect  is  not  necessarily  equivalent  and  can  affect  people’s 
choices.  Thus  the  automated  agent  will  determine  when  to 
use  a  separate  presentation  and  when  to  use  a  combined 
presentation  in  order  to  encourage  the  users  to  accept  the 
propositions. 

When  several  prospects  are  proposed,  the  issue  of  brack¬ 
eting  arises.  Read  et  al.  [21]  introduced  the  term  “Choice 
Bracketing”  to  mean  the  grouping  of  choices.  It  has  been 
shown  that  when  people  face  several  choices  in  which  each 
choice  has  several  options,  people  tend  to  treat  these  choices 
separately  rather  than  treating  them  as  a  single  decision. 
Our  agent  must  take  this  into  account  when  considering 
whether  to  use  a  combined  or  separate  presentation  for  a 
problem,  since  similarly  to  what  has  been  shown  on  sepa¬ 
rated  choices,  people  might  also  treat  each  prospect  sepa¬ 
rately  even  if  these  prospects  are  part  of  a  group. 

Behavioral  economic  theory  describes  the  decision  pro¬ 
cesses  that  people  use  when  deciding  whether  to  accept  a 
prospect  or  reject  it.  The  most  significant  theories  in  this 
field  are  the  Expected  Utility  Hypothesis  [13],  the  Prospect 
Theory  [19]  and  the  Cumulative  Prospect  Theory  [26].  We 
embed  these  theories  into  our  agent  in  order  to  model  the 
expected  human  choice  that  will  be  made  for  a  given  set  of 
prospects,  in  order  to  determine  if  the  separate  or  combined 
presentation  should  be  used. 

We  introduce  the  Prospect  Presentation  Problem,  along 
with  its  formal  description.  This  problem  requires  selecting 
whether  to  represent  the  multiple  prospects  in  a  separate 
presentation  or  a  combined  presentation,  while  maximizing 
a  system’s  utility.  We  propose  a  method  for  modeling  and 
handling  grouped  separate  prospects.  We  use  different  de¬ 
cision  process  models  and  settings  in  order  to  compose  an 
agent  that  is  capable  of  solving  the  Prospect  Presentation 
Problem.  We  demonstrate  the  efficiency  of  the  agent,  in 
choosing  the  better  presentation  method,  using  an  exten¬ 
sive  experimental  evaluation. 


2.  BACKGROUND 

In  this  section,  we  first  provide  a  very  brief  scan  in  the 
field  of  automated  human  persuasion  and  then,  since  our 
proposed  agent  integrates  behavioral  economic  theory,  we 
describe  theories  upon  which  we  rely.  Various  methods  have 
been  proposed  methods  based  on  technology  for  persuading 
humans  into  taking  certain  actions.  Most  common  methods 
do  not  involve  agents  at  all  [12].  Some  of  the  prior  work 
involving  agents  has  attempted  to  influence  people’s  decision 
making  by  providing  them  advice  [5,  4] ,  by  offering  monetary 
incentives  [6],  by  removing  some  of  the  options  available  to 
them  [15,  24]  or  by  revealing  partial  information  to  them  by 
showing  probabilities  on  the  state  of  the  world  [3] . 

2.1  Expected  Utility  Hypothesis 

The  Expected  Utility  Hypothesis  (EUH)  was  initiated  by 
Bernoulli  in  1738  [13].  Under  this  hypothesis,  people  have  a 
utility  function,  u,  which  associates  any  possible  total  wealth 
with  some  utility.  People  use  this  function  when  deciding 
whether  to  accept  or  reject  a  lottery  simply  by  maximizing 
their  expected  utility.  For  example,  a  person  with  a  current 
total  wealth  of  %W  facing  a  prospect  (lottery),  P,  with  a 
probability  of  p  to  win  $a;  and  a  probability  of  1  —  p  to  lose 
%y,  will  compare  the  expected  utility  from  accepting  the 
offer: 

U{P)^u{W +  x)-p  +  u{W -v)-{l-p)  (1) 

with  the  expected  utility  from  rejecting  the  offer,  which  is 
simply  u{W).  The  person  will  accept  the  lottery  if  the  for¬ 
mer  is  greater  and  reject  it  otherwise.  A  common  utility 
risk  averse  function,  suggested  by  Bernoulli  himself,  is  the 
log  function: 

u{X)  =  log{X)  (2) 

2.2  Prospect  Theory 

The  Prospect  Theory  was  presented  by  Kahneman  and 
Tversky  in  [19]  and  later  refined  to  the  Cumulative  Prospect 
Theory  (CPT)  in  [26].  The  Prospect  Theory  is  based  on 
three  principles.  The  first  is  that  people  do  not  take  into 
account  their  total  wealth  when  accepting  or  rejecting  an 
uncertain  opportunity  (as  suggested  by  the  expected  util¬ 
ity  hypothesis  [13]),  but  rather  use  their  current  wealth  as 
a  baseline,  and  will  be  happy  if  they  win  an  amount  and 
become  upset  if  they  lose  an  amount.  The  second  principle 
is  loss  aversion,  where  people  hate  losing  more  than  they 
like  winning.  The  third  principle  is  that  people  have  a  sub¬ 
jective  representation  of  probabilities  and  do  not  interpret 
probabilities  fully  rationally,  but  rather  use  their  own  de¬ 
cision  weights  when  deciding  whether  to  reject  or  accept  a 
gamble.  In  his  book,  Kahneman  [18]  (p.314)  gives  the  fol¬ 
lowing  examples:  The  decision  weight  that  corresponds  to 
a  90%  chance  is  71.2%,  while  the  decision  weight  that  cor¬ 
responds  to  a  10%  chance  is  18.6%.  According  to  these  ex¬ 
amples,  people  are  likely  to  prefer  a  guaranteed  outcome  of 
$80  than  a  gamble  with  a  90%  chance  of  winning  $100,  since 
the  latter  is  only  worth  $71.2  to  them.  Tversky  and  Kahne¬ 
man  elicited  these  weights  by  sequentially  asking  subjects  to 
choose  between  a  specific  lottery  and  many  different  guar¬ 
anteed  outcomes.  The  equivalent  to  the  given  lottery  for  a 
certain  subject  was  set  to  the  average  between  the  great¬ 
est  rejected  guaranteed  outcome  and  the  smallest  accepted 
guaranteed  outcome  [26].  However,  these  decision  weights 
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depend  on  people’s  personalities,  their  wealth,  culture  and 
the  scope  of  the  payoff  in  question.  The  cumnlative  prospect 
theory  determines  the  value  for  any  prospect  based  on  its 
possible  outcomes  and  the  probability  of  each  of  its  out¬ 
comes.  Given  a  prospect  P  which  is  composed  of  T  possible 
ordered  outcomes  (as  defined  by  Tversky  and  Kahneman), 
{xi,X2,  and  the  first  t  are  negative  outcomes,  i.e. 

*1  <  *2  <  ...  <  iCt  <  0  <  Xt+i  <  ...  <  XT-  Each  outcome 
is  associated  with  some  probability  p{x).  The  value  of  the 
prospect  is  given  by  the  following  formula: 


t  /  i  —  1  i—1  \ 

17(P)  =  •  f  -w(J^p(j))  j -b 


J  =  1 


i=t  +  l 


j=i+l 


j=i  +  l 


where  v(x)  stands  for  the  value  function  and  w  is  the  weight¬ 
ing  function  (the  decision  weight  function  described  above). 
Both  of  these  functions  must  be  non-decreasing,  and  ui(0)  = 
0,ui(l)  =  1.  u  is  negative  for  losses  and  positive  for  gains, 
and  u(0)  =  0.  The  intuition  behind  this  formula  is  that 
every  possible  output’s  value  is  assumed  to  have  an  impact 
which  is  proportionate  to  the  marginal  affect  that  its  ac¬ 
cumulated  probability  has  on  the  weighting  function.  For 
example,  given  a  prospect  P'  with  three  possible  outcomes, 
$2,  $3  and  $10  (no  negative  outcomes)  with  probabilities 
of  p($2)  =  0.1,p($3)  =  0.7,p($10)  =  0.2,  the  value  of  the 
prospect  is  given  by: 


U(P')  =  w($10)  •  w(0.2)  -bu($3)  •  (w(0.9)  -  w(0.2))-b 

w($2)  •  (w(l)  -  w(0.9)) 

Note  that  due  to  the  nature  of  w  and  v,  the  value  of  P'  is  at 
least  ?;($2).  This  complies  with  the  fact  that  the  prospect 
guarantees  a  win  of  at  least  $2. 

Tversky  and  Kahneman  suggested  the  value  function: 


v(x) 


x°‘  if  a;  >  0 

—p{—xY  if  a;  <  0 


(4) 


where  a,  /3  and  p  are  parameters,  and  the  weighting  function 
is: 


w(p) 


_ _ 

(p7_(i_p)7)i-^ 


(5) 


where  7  is  a  parameter  used  for  positive  payoffs  and  is  re¬ 
placed  by  a  different  parameter,  5,  for  negative  payoffs.  Sev¬ 
eral  studies  try  to  estimate  parameters  for  the  Prospect  The¬ 
ory  [17,  22,  16],  however  most  studies  try  to  maximize  the 
likelihood  of  the  results  obtained  by  each  subject  individu¬ 
ally.  This  approach  could  not  be  applied  in  our  work  since 
we  build  a  model  based  on  a  group  of  users  and  apply  this 
model  to  new  users  (for  whom  we  have  little  or  no  data). 
Building  a  model  for  each  and  every  user  will  not  allow  us 
to  generalize  the  model  to  new  subjects. 


2.3  Logit  Quantal  Response 

Stochastic  decision-making  (logit  quantal  response)  sug¬ 
gests  that  when  humans  need  to  make  a  choice  among  sev¬ 
eral  options,  the  option  yielding  the  greater  utility  to  the 
user  is  more  likely  to  be  chosen  than  the  option  yielding 
a  lesser  utility.  However,  an  option  yielding  a  lesser  util¬ 
ity  may  occasionally  be  chosen.  Logit  quantal  reaponse  is 


very  common  in  the  literature  which  aims  to  model  human 
behavior,  [7,  10,  4,  20],  and  suggests  that  when  a  person 
confronts  several  possible  choices  {Ci,C2,  the  proba¬ 

bility  that  the  person  will  chose  a  specific  choice  Ci  is  given 
by: 

pAC/(Ci) 

where  U{C)  is  the  utility  associated  with  choice  C  and  A  is 
a  parameter. 

2.4  Bracketing 

“Choice  Bracketing”,  termed  by  Read  et  al.  ]21],  desig¬ 
nates  the  grouping  of  individual  choices  together  into  sets. 
“Broadly  Bracketing”  indicates  that  the  decision-maker  takes 
all  choices  into  account  when  making  his  decision,  while 
“Narrow  Bracketing”  indicates  that  the  decision-maker  iso¬ 
lates  each  choice  from  all  other  choices.  When  humans  face 
a  broad  spectrum  of  topics,  where  each  topic  consists  of  sev¬ 
eral  options,  they  usually  make  a  decision  on  each  topic  sep¬ 
arately.  A  classic  experiment  that  illustrates  narrow  brack¬ 
eting  was  done  by  Tversky  and  Kahneman  [25] .  They  asked 
their  subjects  the  following  question: 

’’Imagine  that  you  face  the  following  pair  of  concurrent  de¬ 
cisions.  First  examine  both  decisions,  then  indicate  the  op¬ 
tions  you  prefer: 

Choice  I.  Choose  between: 

A.  A  guaranteed  gain  of  $240. 

B.  A  25%  chance  to  gain  $1000  and  a  75%  chance  to 
gain  nothing. 

Choice  II.  Choose  between: 

C.  A  guaranteed  loss  of  $750. 

D.  A  75%  chance  to  lose  $1000  and  a  25%  chance  to 
lose  nothing.” 

Since  people  tend  to  be  risk  averse  with  a  positive  payoff 
and  risk  seeking  with  a  negative  payoff,  a  large  majority  of 
subjects  (73%)  chose  both  A  and  D.  Only  3%  of  the  subjects 
chose  B  and  C.  Combining  A  and  D  yields  a  25%  chance  to 
gain  $240  and  a  75%  chance  to  lose  $760.  However,  com¬ 
bining  B  and  C  dominates  this  with  a  25%  chance  to  gain 
$250  and  a  75%  chance  to  lose  $750.  Tversky  and  Kahneman 
performed  an  additional  experiment  in  which  they  presented 
only  the  following  combined  choices  to  the  subjects,  that  is: 

Choose  between: 

A-l-C.  A  guaranteed  loss  of  $510. 

A-l-D.  A  25%  chance  to  gain  $240  and  a  75%  chance  to 
lose  $760. 

B-l-C.  A  25%  chance  to  gain  $250  and  a  75%  chance  to 
lose  $750. 

B-l-D.  A  6.25%  chance  to  gain  $1000,  a  56.25%  chance 
to  lose  $1000  and  a  37.5%  chance  to  gain  or  lose 
nothing.” 

This  time,  not  a  single  subject  chose  the  dominated  op¬ 
tion  (A-l-D).  This  experiment  demonstrates  that  people  tend 
to  treat  each  decision  on  its  own  and  do  not  combine  the 
choices,  unless  they  are  explicitly  combined  for  them. 
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3.  PROSPECT  PRESENTATION  PROBLEM 

The  prospect  presentation  problem  is  a  decision  problem 
for  a  system  and  is  defined  as  follows.  We  first  define  a  set 
of  simple  prospects  s  =  {P\,P2,  recall  that  a  sim¬ 

ple  prospect  P  is  composed  of  a  probability  Pp  of  gaining  or 
losing  a  certain  amount,  P^.  In  the  prospect  presentation 
problem,  a  system  has  a  set  of  n  sets  of  simple  prospects, 

S  —  {si,  S2,  •••,  Sn}.  Each  set  s  &  S  must  be  offered  to  h 
human  clients.  Each  of  the  human  clients  may  either  accept 
the  set  of  prospects  s  (and  participate  in  the  lotteries  as¬ 
sociated  with  the  prospects)  or  reject  it.  Each  of  the  sets, 
s,  may  be  presented  to  the  human  clients  in  two  different 
presentation  modes  m{s);  the  presentation  mode  may  ei¬ 
ther  be  separate,  which  indicates  that  the  set  of  prospects 
are  presented  separately  (as  they  are),  or  the  presentation 
mode  may  be  combined,  which  indicates  that  the  prospects 
are  validly  combined  into  a  single  prospect.  The  separate 
presentation  mode  of  s  is  denoted  by  s®  and  the  combined 
presentation  mode  of  s  is  denoted  by  s®.  The  probability 
for  any  possible  outcome  must  be  identical  in  both  s®  and 
s®.  A  cost  c(m(s))  may  be  applied  to  the  system  and  may 
depend  on  the  method  of  presentation.  The  system  gains  a 
utility  of  1  —  c(m(s))  every  time  a  human  client  accepts  a 
set  of  prospects.  The  human  clients  are  assumed  to  follow  a 
stochastic  decision  policy,  in  which,  given  a  set  of  prospects, 
s,  and  a  presentation  mode,  m,  p{s,  m)  determines  the  prob¬ 
ability  that  the  humans  will  accept  the  set  of  prospects.  The 
prospect  presentation  problem  is  intended  for  the  system  to 
determine  for  each  of  the  sets  of  prospects,  s,  its  presentation 
mode,  m(s),  in  order  to  maximize: 

^p(s,m(s))-h-(l-c(m(s)))  (7) 

ses 

4.  AGENT  FOR  PROSPECT  PRESENTATION 
PROBLEM 

In  this  section  we  introduce  an  Agent  for  the  Prospect 
Presentation  Problem  (APPP).  Section  4.1  describes  how 
APPP  calculates  the  combined  presentation  for  a  set  of 
prospects  and  solves  the  prospect  presentation  problem.  How¬ 
ever,  this  solution  relies  on  a  component  that  accurately 
models  human  decision  policy.  We  therefore  propose  several 
alternatives  for  APPP’s  composition  of  the  human  model  in 
Section  4.2. 

4.1  Solving  the  Prospect  Presentation  Prob¬ 
lem 

The  first  component  of  the  APPP  agent  is  described  in 
Algorithm  1  and  handles  the  task  of  efficiently  (linear  in 
output  length)  calculating  a  combined  presentation  for  a 
set  of  prospects  s®.  The  algorithm  receives  a  set  of  sim¬ 
ple  prospects  and  outputs  a  hash  map  with  all  of  the  pos¬ 
sible  outcomes  (as  keys)  and  probabilities  (as  values).  The 
algorithm  iterates  via  all  prospects.  In  every  iteration  the 
algorithm  takes  the  previous  iteration’s  result  and  doubles 
it,  once  assuming  that  the  current  prospect  obtained  its  out¬ 
come  and  once  assuming  that  the  current  prospect  did  not 
yield  its  outcome.  For  example,  consider  a  set  of  simple 
prospects  in  which  one  prospect  has  a  25%  chance  to  win 
$37  and  another  prospect  has  a  60%  chance  to  lose  $10, 
i.e.  s  =  {((0.25,  $37),  (0.60,  $  —  10)}.  In  the  first  iteration, 
with  the  prospect  (0.25,  $37),  there  will  be  only  two  possible 


outcomes,  0  with  a  probability  of  0.75  and  $37  with  a  prob¬ 
ability  of  0.25.  In  the  second  (and  last)  iteration,  with  the 
prospect  (0.60,$  —  10),  the  algorithm  will  first  assume  that 
the  (negative)  outcome  was  not  obtained  (with  a  probability 
of  0.40),  and  thus  will  have  two  possible  outcomes:  $37  with 
a  probability  of  0.25  •  0.40  =  0.10  and  $0  with  a  probability 
of  0.75  •  0.40  =  0.30.  Then  the  algorithm  will  add  two  addi¬ 
tional  outcomes,  assuming  that  the  outcome  of  the  second 
prospect  ($  —  10)  was  obtained  (with  a  probability  of  0.60): 
$27  —  $10  =  $17  with  a  probability  of  0.25  •  0.60  =  0.15  and 
$0  -I-  $  —  10  =  — $10  with  a  probability  of  0.75  •  0.60  =  0.45. 


Algorithm  1  Calculation  of  the  combined  presentation  for 
a  set  of  prospects. 

Input:  s  -  A  set  of  simple  prospects  s  =  {Pi,  P2, ...,  A,}, 
where  P  =  (Pf ,  Pf ). 

Output:  s®  -  A  hash  map  holding  all  possible  outcomes  as 
keys  and  their  associated  probabilities  as  values. 

1:  s®[0]  ^  1 

2:  for  each  prospect  P  in  s  do 
3:  s®'  ^  s® 

4:  clear  s® 

5:  for  each  outcome  in  s®'  do 

6:  s‘^[outcome\  s‘’'[outeome]  •  (1  —  P^)  ^ 

7:  s‘^[outcome  -|-  P®’]  s'^' [outcome]  ■  P^ 

8:  end  for 

9:  end  for 

10:  return  s® 


The  second  component  of  the  APPP  agent  is  described  in 
Algorithm  2.  This  is  the  procedure  that  solves  the  prospect 
presentation  problem.  The  input  for  Algorithm  2  is  a  set  of 
prospect  sets,  a  cost  function  and  a  human  decision  policy. 
The  output  is  a  determination  policy  for  each  prospect  set. 
The  determination  policy  determines  whether  to  use  the  sep¬ 
arate  or  the  combined  method  for  each  prospect  set.  This 
algorithm  simply  iterates  via  all  sets  of  prospects  and  calcu¬ 
lates,  for  each  of  the  sets,  which  of  the  presentation  methods 
is  more  profitable  for  the  system,  i.e.  whether  p{s,  separate)- 
(l—c{separate))  is  larger  thanp(s,  combined) ■  {I— c{combined)) 
or  vice  versa.  Were  the  human  decision  policy  to  be  known. 


Algorithm  2  Procedure  for  solving  the  prospect  presenta¬ 
tion  problem. 

Input:  A  set  composed  of  prospect  sets  S.  A  cost  function 
c(m(s)),  and  a  human  decision  policy  p{s,m{s)). 
Output:  A  determination  policy,  m,  for  each  of  the 
prospect  sets. 

1:  for  each  problem  s  in  S'  do 

2:  if  p{s,  separate)  ■  (1  —  c{separate))  >  p{s,  combined)  ■ 

(1  —  c{combined))  then 
3:  set  m{s)  -h-  separate-, 

4:  else 

5:  set  m{s)  <r-  combined-, 

6:  end  if 

7:  end  for 


the  algorithm  would  have  fully  solved  the  prospect  presen¬ 
tation  problem.  However,  in  real  life,  a  system  agent  facing 
the  prospect  presentation  problem  is  not  likely  to  have  ac¬ 
cess  to  the  human  decision  policy,  p[s,  m(s)).  Therefore,  the 
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major  concern  for  an  agent  facing  the  prospect  presentation 
problem  is  to  accurately  model  the  human  decision  policy. 


4.2  Decision  Policy  Modeling  in  APPP 

An  agent  facing  the  prospect  presentation  problem  does 
not  have  specific  information  about  the  human  user,  aud 
therefore  must  use  a  general  model  for  modeling  human  de¬ 
cision  policy.  While  several  theories  may  be  considered  for 
building  this  model,  the  Expected  Utility  Hypothesis  and 
Cumulative  Prospect  Theory  definitely  stand  out  as  being 
significant  in  their  field.  We  therefore  decided  to  embed  each 
of  these  theories  in  APPP’s  decision  policy  model,  but  it  is 
possible  to  embed  other  theories  into  the  agent  should  one 
want  to.  However,  in  both  the  expected  utility  hypothe¬ 
sis  and  the  cumulative  prospect  theory,  a  human’s  response 
does  not  depend  on  the  form  of  the  presentation  of  the  prob¬ 
lem.  This  implies  that  both  presentation  methods  {combined 
and  separated)  would  yield  the  same  probability  that  the 
user  will  accept  a  given  lottery  regardless  of  the  lottery,  i.e. 
for  any  s,  p{s,  combined)  =  p{s,  separate).  This  assumption 
is  clearly  inappropriate  for  our  work  (and  is  shown  to  be 
false  in  the  results  section).  Therefore,  each  of  the  theories 
requires  a  slight  modification  when  considering  the  separate 
representation  method,  by  taking  the  bracketing  effect  (see 
section  2.4)  into  account. 

We  use  the  following  subsections  to  describe  in  detail  how 
each  of  the  theories  can  be  embedded  into  APPP.  All  of 
the  methods  we  test  need  to  set  some  parameters,  therefore 
APPP  requires  training  data.  The  data  set,  ip,  is  composed 
of  a  set  of  tuples  <  s,  m{s),d  >,  in  which  s  is  a  set  of  sim¬ 
ple  prospects  presented  to  a  human  user,  m(s)  determines 
whether  the  set  of  prospects  were  presented  in  the  combined 
method  or  in  the  separated  method,  and  d  is  a  boolean,  in¬ 
dicating  whether  or  not  the  user  decided  to  participate  in 
the  lottery.  In  order  to  accurately  model  human  decision¬ 
making,  it  is  essential  to  assume  stochastic  decision-making, 
since  the  agent  is  required  to  evaluate  the  probability  that  a 
user  will  accept  a  lottery.  Not  assuming  stochastic  decision¬ 
making  would  mean  that  a  lottery  (possibly  depending  on 
its  presentation  method)  would  either  be  accepted  by  every¬ 
one  or  rejected  by  everyone,  i.e.  p{s,m{s))  €  {0,1}.  (It  is 
not  required  to  assume  that  every  individual  actually  uses 
stochastic  decision-making,  but  that  the  crowed  as  a  whole 
can  be  modeled  as  using  stochastic  decision-making.) 

APPP  assumes  logit  quautal  response  and  thus  relies  on 
Equation  6.  Recall  that  in  the  prospect  presentation  prob¬ 
lem,  the  user  needs  to  choose  between  participating  in  a 
prospect  (or  a  set  of  simple  prospects  in  the  separate  presen¬ 
tation  method)  or  not.  Thus,  the  user  must  actually  choose 
between  the  lottery  and  the  value  of  not  participating  in  it, 
denoted  by  U{null).  In  EUH,  U{null)  =  m($IU),  where  W  is 
the  person’s  initial  wealth,  and  in  CPT,  U{null)  =  u(0)  =  0. 
Therefore,  given  a  lottery  L,  according  to  Equation  6,  the 
probability  that  a  user  will  accept  that  lottery  is: 


P(L) 


1 

I  _|_  g>.{u(null)-U(L)) 


(8) 


^In  6  and  7,  if  s‘^[outcome]  or  s‘^ [outcome  +  P^]  already  have 
a  value,  increment  that  value  by  s‘^' [outcome]  ■  (1  —  P^)  or 
s‘^' [outcome]  ■  P^  respectively. 


4.2.1  Modeling  using  Prospect  Theory  with  Learned 
Parameters 

The  first  model  we  consider  for  APPP’s  decision  policy  is 
the  cumulative  prospect  theory.  We  use  cumulative  prospect 
theory,  CPT,  (see  section  2.2)  in  order  to  evaluate  U (L)  for  a 
user  facing  the  eombined  method  (a  single  prospect).  How¬ 
ever,  as  mentioned  above,  when  considering  the  separated 
method  (a  set  of  simple  prospects),  APPP  deviates  from 
CPT.  For  the  instances  in  the  data  set  using  the  combined 
method  of  presentation,  in  which  the  user  is  only  presented 
with  a  single  prospect  (s“),  APPP  calculates  U{s‘^)  accord¬ 
ing  to  Equation  3  (and  Equations  4  and  5  for  the  value  and 
weighting  functions  respectively).  APPP  assumes  that  peo¬ 
ple  who  face  the  separated  method  evaluate  each  prospect 
separately  and  then  combine  all  values  together  to  receive 
the  total  value  of  the  lottery^.  This  assumption  is  based 
on  the  bracketing  effect  (see  section  2.4),  which  suggests 
that  people  treat  each  problem  separately,  and  thus  we  as¬ 
sume  that  they  will  evaluate  each  prospect  separately.  For¬ 
mally,  given  a  set  of  prospects,  s,  presented  in  the  separated 
method,  the  value  of  the  set  of  prospects  is  given  by: 

U{s^)  =  U{P)  (9) 

PGs 

APPP  searches  for  parameters  a,  /3,  jj,,  7,  5  and  A  that  mini¬ 
mize  the  mean  squared  error  (MSE)  between  p{s,  m{s))  and 
the  actual  fraction  of  users  in  (tp)  who  accepted  lottery  s 
{d  =  true)  out  of  all  of  those  who  were  shown  that  lottery 
using  m{s)  as  the  presentation  method.  Once  APPP  has 
set  the  parameters  to  use  for  the  decision  policy,  it  can  be 
used  to  determine  how  to  present  a  new  set  of  prospects. 
Given  a  set  of  prospects,  s,  and  a  presentation  mode,  m(s); 
if  the  presentation  mode  is  combined,  APPP  uses  Equations 
8  and  3  and  parameters  a,  /3,  /r,  7,  (5  and  A.  If  the  presen¬ 
tation  mode  is  separated,  APPP  uses  Equations  8,  9  and 
3  and  the  parameters  {a,  j3,  p,  7,  5  and  A)  to  evaluate  the 
probability  that  the  user  will  accept  the  associated  lottery. 

4.2.2  Modeling  using  Prospect  Theory  with  Original 
Parameters 

We  also  investigated  another  possible  model;  it  is  the  same 
model  described  in  4.2.1,  but  rather  than  learning  the  pa¬ 
rameters  a,  P,  pL,  7  and  S,  APPP  uses  the  parameters  pro¬ 
posed  by  Kahneman  and  Tversky.  That  is,  a  —  0.88,  /3  = 
0.88, /r  =  2.25,7  =  0.61  and  5  =  0.69.  APPP  only  uses  the 
data  to  evaluate  A. 

4.2.3  Modeling  using  Expected  Utility  Hypothesis 

As  the  Expected  Utility  Hypothesis  is  very  well  known, 

we  also  show  how  to  embed  it  into  APPP.  APPP,  based  on 
EUH,  uses  Equations  1  and  2®.  As  in  the  model  assuming 
CPT,  we  must  determine  how  to  account  for  sets  of  prospects 
presented  in  the  separated  method.  However,  using  EUH, 
APPP  may  not  simply  use  the  exact  same  approach  as  when 
using  CPT,  since  in  EUH,  U{P)  includes  the  initial  wealth. 
Therefore,  if  we  were  simply  to  add  up  the  utilities  from 
all  of  the  prospects  (using  Equation  9),  we  would  end-up 

^This  approach  in  an  environment  of  only  simple  prospects 
is  actually  similar  to  the  assumptions  made  by  the  prospect 
theory  rather  than  CPT. 

^In  practice  we  also  tried  two  different  power  functions,  but 
they  yield  the  exact  same  results  as  the  log  function  (pre¬ 
sented  in  Section  5.2). 
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Suppose  you  are  facing  the  following  set  of  lotteries, 

you  may  either  participate  in  all  lotteries  or  reject  them  all:  (#  7  of  20) 

-  A 1 .00%  chance  to  lose  $445.40,  (and  a  99.0%  chance  to  gain/lose  nothing). 

-  A  79.00%  chance  to  gam  $2.40,  (and  a  21 .0%  chance  to  gain/lose  nothing). 

-  A  83.00%  chance  to  gam  $3.30,  (and  a  17.0%  chance  to  gain/lose  nothing). 

The  following  pie  charts  which  present  the  lotteries  may  assist  you  in  making  your  decision: 


Which  option  would  you  choose; 

0  Reject  all  lotteries. 

0  Participate  in  all  lotteries. 

\  Submit  1 


Figure  1:  A  subject  facing  a  set  of  prospects  pre¬ 
sented  separately. 

adding  the  initial  wealth  several  times.  We  therefore  propose 
a  simple  modification,  using  the  following  equation: 

[/(s'*)  =  m(W")  +  ^  (f/(P) -m(W"))  (10) 

Pes 

APPP  based  on  EUH,  searches  for  parameters  W  and  A  that 
minimize  the  mean  squared  error  (MSE)  between  p{s,  m{s)) 
and  the  actual  fraction  of  users  in  (■0)  who  accepted  lottery  s 
{d  =  true)  out  of  all  those  who  were  shown  that  lottery  using 
m(s)  as  the  presentation  method.  Given  a  set  of  prospects, 
s,  and  a  presentation  mode,  m(s);  if  the  presentation  mode 
is  combined,  APPP  uses  Equations  8  and  1  and  parameters 
W  and  A.  If  the  presentation  mode  is  separated,  APPP 
uses  Equations  8,  10  and  1  and  the  parameters  {W  and 
A)  to  evaluate  the  probability  that  the  user  will  accept  the 
associated  lottery. 

5.  EVALUATION 
5.1  Experimental  Setup 

We  ran  our  experiments  using  Amazon’s  Mechanical  Turk 
(AMT)  [1].  We  constructed  a  total  of  120  sets  of  simple 
prospects,  with  k  (the  number  of  simple  prospects  in  a  set) 
varying  between  3  and  5.  The  upper  boundary  of  5  was  cho¬ 
sen  since  the  number  of  possible  outcomes  is  exponential  in 
the  number  of  k  (2®  =  32)  and  we  didn’t  want  to  present 
too  many  possible  outcomes  to  the  subjects.  Each  simple 
prospect  (P)  had  a  random  probability  (Pp)  between  1% 
and  100%  (only  whole  probabilities)  and  a  random  expected 
outcome  {Pp  ■  Px)  between  —$15.00  and  -l-$15.00.  For  the 
human  decision  not  to  be  trivial,  every  set  of  prospects  had 
at  least  one  prospect  with  a  negative  outcome  and  one  with 
a  positive  outcome.  For  ethical  reasons,  since  we  did  not 
want  to  encourage  traditional  gambling,  we  ensured  that  all 
gambles  had  a  positive  expected  utility.  Therefore,  a  player 
that  tries  to  maximize  her  expected  outcome  should  have 
accepted  all  gambles.  Thus,  the  subjects  were  not  urged 
into  a  gamble  which  was  not  good  for  them.  We  recruited  a 
total  of  612  participants.  58.1%  of  the  subjects  were  males 
and  41.9%  were  females.  Subjects’  ages  ranged  from  18  to 
73,  with  a  mean  of  31.6,  a  median  of  29  and  a  standard 
deviation  of  11.0.  All  subjects  were  residents  of  the  USA. 


Figure  2:  A  subject  facing  a  set  of  prospects  pre¬ 
sented  in  the  combined  mode. 


The  subjects  were  paid  30  cents  to  participate  in  the  experi¬ 
ment.  Each  subject  was  presented  with  20  sets  of  prospects, 
half  in  their  original  form  and  half  as  combined  prospects. 
This  resulted  in  an  average  of  approximately  50  instances 
for  each  of  the  120  sets  of  prospects  for  each  of  the  two 
different  presentation  modes.  The  subjects  were  given  the 
following  instructions:  ’’Suppose  you  are  facing  the  follow¬ 
ing  lottery  /  set  of  lotteries,  you  may  either  participate  in 
it  /  in  all  lotteries  or  reject  it  /  them  all”.  (The  exact  text 
depended  on  the  mode  of  presentation  of  the  current  set  of 
prospects.)  To  enhance  comprehension,  we  also  provided  the 
subjects  with  pie-charts  presenting  the  prospects  (as  used  in 
[2]).  The  following  explanation  was  provided:  ’’The  follow¬ 
ing  pie  chart  (s)  which  present  (s)  the  lottery  /  lotteries  may 
assist  you  in  making  your  decision.”  Figure  1  presents  an  ex¬ 
ample  of  a  screen-shot  for  a  subject  facing  a  set  of  prospects 
presented  separately,  and  Figure  2  presents  an  example  of 
a  screen-shot  for  a  subject  facing  the  same  set  of  prospects 
presented  in  the  combined  mode.  Note  that  there  are  3 
prospects  in  the  separate  mode,  and  thus  2®  =  8  in  the  com¬ 
bined  mode.  We  set  the  cost  function  to  0  for  the  separated 
method  and  to  0.15  for  the  combined  method.  This  setting 
was  chosen  since  we  assume  that  the  problem  is  provided  as 
the  separate  prospects  and  therefore  some  cost  is  associated 
with  presenting  a  combined  prospect  to  the  user.  A  cost 
of  0.15  to  the  combined  mode,  equalizes  the  performance  of 
the  combined  mode  to  the  separate  mode. 

5.2  Results 

We  ran  APPP  using  10-fold  cross-validation  on  the  data. 
In  every  fold  APPP  was  trained  on  108  sets  of  prospects, 
and  tested  on  the  remaining  12  sets  of  prospects.  For  each 
of  these  sets,  APPP  had  to  decide  whether  to  present  the 
prospects  separately  or  combined.  Figure  3  presents  the  per- 
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Agent 

Acceptance 

rate 

Combined 

presentation 

Average 

cost 

Score 

Number  of 
parameters 

APPP 

42.8% 

37.5% 

0.0266 

0.401 

6 

APPP-KT 

39.6% 

16.7% 

0.009 

0.387 

1 

Combined 

44.4% 

100% 

0.066 

0.378 

0 

Separate/ APPP-EUH 

37.8% 

0% 

0 

0.378 

0-2 

Table  1:  Average  performance  of  APPP  compared  to  the  other  agents 


formance  of  APPP  in  three  modes.  The  APPP  refers  to  the 
agent  nsing  the  learned  parameters  as  described  in  Section 
4.2.1,  APPP-KT  refers  to  the  agent  that  uses  the  param¬ 
eters  described  by  Kahneman  and  Tversky  as  explained  in 
Section  4.2.2  and  APPP-EUH  is  the  agent  described  in  4.2.3. 
These  versions  of  the  agent  are  compared  to  an  agent  that 
always  presents  the  combined  mode  and  an  agent  that  al¬ 
ways  presents  the  separate  mode.  The  black  bars  represent 
the  95%  confidence  interval  using  a  paired  t-test.  APPP 
significantly  (t(119)  =  2.3645,  p  <  0.01  using  a  paired  t-test 
on  the  score  obtained  from  every  set  of  prospects)  ontper- 
formed  all  other  methods,  and  yielded  an  increase  of  6%  in 
the  average  score  over  the  two  baselines.  Recall  that  APPP 
may  only  control  the  method  of  presentation  to  the  users 
(and  not  the  actual  lotteries),  therefore  this  achievement  is 
very  impressive.  Table  1  provides  additional  details  regard¬ 
ing  the  acceptance  rate  of  APPP  and  the  baseline  agents.  As 
can  be  observed  by  the  table,  the  combined  mode  enjoyed  a 
much  greater  acceptance  rate  than  the  separate  mode.  This 
clearly  demonstrates  that  the  presentation  mode  has  an  im¬ 
pact  on  the  human  acceptance  rate,  justifying  our  initial 
assumptions.  However,  recall  that  presenting  the  combined 
method  requires  some  additional  effort  and  is  therefore  as¬ 
sumed  to  be  associated  with  some  cost.  If  this  cost  is  re¬ 
duced,  the  combined  mode  becomes  much  more  appealing, 
and  vice  versa,  as  the  cost  increases,  the  separated  mode 
becomes  more  appealing.  It  is  not  surprising  that  APPP 
yields  a  slightly  lower  acceptance  rate  than  the  combined 
agent,  since,  as  mentioned,  many  more  subjects  accept  the 
combined  mode  than  the  separated  mode,  and  APPP  chose 
to  present  the  combined  mode  only  in  37.5%  of  the  sets. 
APPP-EUH  did  not  present  the  combined  mode  in  any  of 
the  sets.  This  was  not  because  it  assumed  that  using  the 
separate  mode  is  more  appealing  to  the  user,  but  because  it 
was  not  willing  to  pay  the  cost  associated  with  presenting 
the  combined  mode  (if  the  cost  was  totally  removed,  APPP- 
EUH  would  present  the  combine  mode  in  94%  of  the  sets). 
Recall  that  the  expected  outcome  on  all  lotteries  was  always 
positive,  yet  on  average  people  still  accepted  less  than  50% 
of  the  lotteries. 

Regarding  the  pie-charts,  79.1%  of  the  subjects  said  that 
the  pie-charts  helped  them  and  only  19.6%  said  that  they 
didn’t  help  them.  Only  6  subjects  (less  than  %1)  said  that 
they  did  not  understand  the  pie-charts.  While  the  total  av¬ 
erage  of  participation  in  the  lotteries  was  41.5%,  females 
participated  on  average  in  only  37.9%,  which  is  significantly 
lower  {p  <  0.01  using  ANOVA  test)  than  males  who  partic¬ 
ipated  on  average  in  44.1%  of  the  lotteries.  This  indicates 
that  females  are  more  risk  averse  than  males  (this  finding 
was  also  present  in  many  studies  such  as  [8]).  We  also  found 
that  young  people,  up  to  age  29  (which  was  our  median), 
are  significantly  (p  <  0.01)  more  likely  to  participate  in  the 
lottery  than  people  aged  30  and  above  (44.0%  vs.  37.7%). 


APPP  APPP-KT  Combined  Separate/ 

APPP-EUH 


Figure  3:  Average  score  obtained  by  each  of  the 
methods. 


Risk  aversion  also  seems  to  increase  with  education,  as  sub¬ 
jects  with  only  a  high  school  education  (49.6%)  participated 
in  43.3%  of  the  lotteries,  while  subjects  with  a  bachelor’s  or 
a  master’s  degree  or  a  PhD  participated  in  only  39.7%  of 
the  lotteries  (these  results  differ  statistically  with  p  <  0.05, 
however,  these  results  may  be  explained  by  the  fact  that  the 
younger  subjects  tend  to  have  lower  education).  Interest¬ 
ingly,  while  the  gap  between  the  males  and  females  partici¬ 
pating  in  the  lotteries  was  smaller  when  the  prospects  were 
combined  (6.93%  vs.  5.62%),  the  gap  between  the  young 
subjects  and  the  older  ones  was  almost  doubled  in  size  when 
the  presentation  mode  was  combined  (4.29%  vs.  8.31%). 
This  finding  may  encourage  future  work  on  a  personalized 
agent  based  on  demographic  data  alone. 

5.3  Discussion  and  Future  Work 

In  this  study  we  used  k  <=  5  (the  number  of  simple 
prospects  in  a  set).  It  remains  questionable,  what  will  hap¬ 
pen  as  the  number  of  prospect  selection  problems  increases. 
In  such  a  case,  the  pie  chart  may  become  very  complex  as 
the  number  of  outcome  options  increases  exponentially.  One 
option  is  to  group  together  similar  outcomes,  but  still  it  is 
unclear  how  to  do  so.  Another  interesting  question  is  what 
happens  for  lower  values  of  k.  Lower  values  of  k  should  en¬ 
able  a  better  evaluation  of  the  problem  and  a  better  compre¬ 
hension  of  the  agent’s  advice;  it  remains  to  be  seen  how  this 
affects  the  users’  interaction  with  the  agent.  We  chose  the 
pie  charts  (combined  and  separate)  in  order  to  enhance  com¬ 
prehension  of  the  proposed  prospects.  The  users  provided 
positive  feedback  to  these  charts.  It  would  be  interesting 
to  study  how  much  of  a  role  they  played  in  the  user  accep¬ 
tance  rates.  Enhancing  APPP  to  include  more  presentation 
modes  or  other  visual  enhancements  would  be  an  interesting 
extension  of  this  study.  Using  CPT  with  learned  parame¬ 
ters  was  shown  to  outperform  other  methods  we  tested.  In 
the  future  we  would  like  to  consider  modifying  the  functions 
suggested  by  Tversky  and  Kahneman  to  see  if  it  is  possible 
to  further  improve  the  APPP’s  performance.  Another  pos- 
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sible  extension  would  be  to  study  how  to  apply  alternative 
modeling  theories  such  as  the  priority  heuristic  [9]. 

6.  CONCLUSION 

In  this  paper  we  introduced  the  prospect  presentation  prob¬ 
lem,  in  which  users  are  presented  with  sets  of  prospects  that 
must  be  accepted  or  rejected  as  a  group  (such  as  an  invest¬ 
ment  portfolio).  We  refer  to  a  system  that  gains  a  positive 
utility  when  clients  accept  the  prospects  (decide  to  invest). 
We  defined  the  prospect  presentation  problem  as  determin¬ 
ing,  for  each  set  of  prospects,  which  presentation  mode  to 
use  in  order  to  maximize  the  system’s  utility.  We  presented 
the  APPP  agent  that  solves  the  prospect  presentation  prob¬ 
lem  and  chooses  between  representations  of  complex  bene¬ 
ficial  proposals.  APPP  uses  Cumulative  Prospect  Theory 
(CPT)  in  order  to  model  human  decision-making  and  uses 
this  model  to  select  the  better  representation  method  for  a 
set  of  prospects.  We  demonstrated  that  fixing  the  presenta¬ 
tion  method  to  always  present  the  prospects  separately,  or 
always  present  them  combined,  results  in  a  lower  score  than 
using  APPP  to  select  the  presentation  mode  based  on  the 
human  model  and  a  given  set  of  prospects.  We  investigated 
several  variations  on  decision  process  models  and  found  that 
using  CPT  results  in  the  most  successful  agent  for  selecting 
the  presentation  mode.  Furthermore,  learning  the  param¬ 
eters  for  CPT  from  sets  of  prospects  presented  in  the  two 
presentation  modes  resulted  in  a  better  agent  than  simply 
using  the  parameters  elicited  by  Kahneman  and  Tversky 
in  their  original  study.  We  show  that  the  combined  method 
yields  much  higher  acceptance  rates,  and  thus,  if  the  cost  as¬ 
sociated  with  presenting  the  combined  method  is  very  low, 
it  may  be  more  benehcial  for  the  system  to  always  use  the 
combined  mode.  If  the  cost  is  not  negligible,  we  suggest  us¬ 
ing  APPP  for  determining  which  sets  to  present  separately 
and  which  to  present  combined. 
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